An extension of the Lyapunov analysis for the predictability problem 
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The predictability problem for systems with different characteristic time scales is investigated. 
It is shown that even in simple chaotic dynamical systems, the leading Lyapunov exponent is not 
sufficient to estimate the predictability time. This fact is due the saturation of the error on the fast 
components of the system which therefore do not contribute to the exponential growth of the error 
at large errors. It is proposed to adopt a generalization of the Lyapunov exponent which is based 
on the natural concept of error growing time at finite error size. The method is first illustrated on 
a simple numerical model obtained by coupling two Lorenz systems with different time scales. As 
a more realistic example, this analysis is then applied to a toy model of Atmospheric circulation 
recently introduced by Lorenz. 



The prediction of the future state of a system known the actual state is a fundamental problem with obvious 
applications in geophysical flows (Leith, 1975; Leith and Kraichnan, 1972; Leith, 1978). There are many limitations 
to the ability of predicting the state of a geophysical system, e.g. the atmosphere, one of the most important is the 
lack of knowledge, or the difficulty of full implementation, of the equations of motion. Still, even if one assume to 
perfectly know the system and to have sufficiently large computers, the predictability can be severely limited by the 
dynamics itself, i.e. the "intrinsic unpredictability" the a system which is the subject of our study. 

A well known, and very popular, example of low-predictable system is given by a chaotic system (Lorenz, 1963). By 
definition, chaotic dynamical systems display sensible dependence on initial conditions: two initially close trajectories 
will diverge exponentially in the phase space with a rate given by the leading Lyapunov exponent X m ax (see Eckmann 
and Ruelle, 1985). Because the initial condition can be measured only with a finite uncertainty 5, we can know the 
future state of the system at a tolerance level A only up to a maximum time 



One important consequence of equation (gj) is that the predictability time has a very weak dependence on the precision 
of the initial condition and on the tolerance, therefore the predictability time is an intrinsic quantity of the system as 
the Lyapunov exponent is. 

The naive formula (]l|) for the predictability problem holds only for infinitesimal perturbations and in non intermit- 
tent systems; in the general case one has a series of problems and subtle points which have been objected of several 
studies in last years (Crisanti et al., 1993; Aurell et al., 1996, 1997). One delicate issue is particularly relevant for 
our present study and essentially says that, although the Lyapunov exponent for the atmosphere (as a whole) is 
presumably rather large (due to the small scale turbulence), the large scale behavior of the system can be forecasted 
with good accuracy for several days (Lorenz, 1969; Lorenz, 1982; Simmons et al., 1995). 

The apparent paradox comes from the identification of the predictability time with the inverse of the Lyapunov 
exponent based on equation ([!]) which is actually of little relevance even in few degree-of-freedom dynamical systems. 
Indeed, in presence of different characteristic time scales, as is the case in any realistic model of geophysical flows, the 
Lyapunov exponent will be roughly proportional to the inverse smallest characteristic time. This time is associated 
to the smallest, low energy containing scales which, after the fast saturation, do not play a role any more in the error 
growth law. Large errors will grow, in general, with the characteristic time of the largest, energy containing scales 
(Leith, 1971; Leith and Kraichnan, 1972). Thus when the initial error is not very small, as is often the case in a 
predictability experiment, the leading Lyapunov exponent may play no role at all. 

To be more quantitative, in this paper we investigate the predictability problem in two time scale dynamical systems. 
We apply a recently introduced generalization of the Lyapunov exponent to finite perturbations. We will show that 
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the Finite Size Lyapunov Exponent (FSLE) is more suitable for characterizing the predictability of complex systems 
where the growth rate of large errors in not ruled by the Lyapunov exponent. 

The models considered here are crude approximations of a realistic geophysical flow also because both the subsystems 
have a single time scale. It would be interesting to extend the investigation to more realistic situations and comparing 
the latter case with present results. 

This remaining of the paper is organized as follows: in section || we introduce the Finite Size Lyapunov Exponent 
which is applied to the system models in section III. Section fylis devoted to conclusions. 



II. THE FINITE SIZE LYAPUNOV EXPONENT 



The notion of Lyapunov exponent is based on the average rate of exponential separation of two infinitesimally close 
trajectory in the phase space: 

1 Sx(t) 

A mal = hm hm - In (2) 
t^oo Sx(0)->O t Sx(0) 

where 5x(t) is the distance between the trajectories with a suitable norm and the two limits cannot be interchanged. 
The standard algorithm (Benettin et al., 1980) for computing the Lyapunov exponent is based on (||), with the trick 
of periodical rescaling of the two trajectory in order to keep their distance "infinitesimal" . 

As already discussed in the previous section, the second limit in (||) is of dubious interest in the predictability 
problem because the initial incertitude on the system variables is in general not infinitesimal. Therefore one would 
like to relax the infinitesimal constrain still maintaining some well defined mathematical properties. Recently, a 
generalization of (|J) which allows to compute the average exponential separation of two trajectories at finite errors 5 
have been introduced. The Finite Size Lyapunov Exponent, X(S), is based on the concept of error growing time T r (8) 
which is the time it takes for a perturbation of initial size S to grow of a factor r. The ratio r should not be taken 
too large, in order to avoid the growth through different scales. The error growing time is a fluctuating quantity and 
one has to take the average along the trajectory as in (0). The Finite Size Lyapunov Exponent is then defined as 



where (...}* denotes the natural measure along the trajectory and (...) is the average over many realizations. For an 
exhaustive discussion on the way to take averages, see Aurell et al. (1997). 

In the limit of infinitesimal perturbations, 5 — > 0, definition (|^) reduces to that of the leading Lyapunov exponent 
(||). In practice, A(<5) displays a plateau at the value X m ax for sufficiently small 5. 

To practically compute the FSLE, one has first to define a series of thresholds 6 n = r n 6o, and to measure the 
time T r (5 n ) that a perturbation with size S n takes to grow up to <5„+i. The time T r (5 n ) is obtained by following the 
evolution of the perturbation from its initial size 5 m i n up to the largest threshold <5 max . This is done by integrating 
two trajectories of the system that start at an initial distance 5 m in- In general, one must take 5 m ; n <C Sq, in order 
to allow the direction of the initial perturbation to align with the most unstable phase-space direction. The FSLE, 
A(<5„), is then computed by averaging the error growing times over several realizations according to (^|). 

Note that the FSLE has conceptual similarities with the e-entropy (Kolmogorov, 1956; see also Gaspard and Wang, 
1993). This latter measures the bandwidth that is necessary for reproducing the trajectory of a system within a finite 
accuracy S. The e-entropy approach has already been applied to the analysis of simple systems and experimental 
data (Gaspard and Wang, 1993), giving interesting results. The calculation of the e-entropy is, however, much more 
expensive from a computational point of view and of little relevance for the predictability problem. 

The computation of the FSLE gives information on the typical predictability time for a trajectory with initial 
incertitude 6. To be more quantitative, one can introduce the average predictability time from an initial error S to a 
given tolerance A as the average error growing time, i.e. 

T ' = l « (4 » 

which reduces to (|l|) in the case of constant A. From general considerations, one expects that X(S) is a decreasing 
function of 5 and thus ([|) gives longer predictability time than ([l]). 
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III. THE MODELS 



We now discuss the application of the FSLE analysis to two relatively simple dynamical systems presenting different 
characteristic time scales. The proposed models are of little physical relevance; they should rather be intended as 
prototypical models for the predictability problem in complex flows. 

The first example is obtained by coupling two Lorenz models (Lorenz, 1963), the first representing the slow dynamics 
and the second the fast dynamics 



dx 



l 

77T 



dx 



dt 



dx 



s) 



dt 
dx\ 

dx 



/) 



~d~T 

(/) 



dt 

(/) 



dx 3 
~~dt 



i («) 



2 _ 



4 S) ) 



f_~(*)~( a ) i r ~( a ) _ -('h _ , M)~(f) 

^ Jb -y <L' g \ \ I g >Aj ~y Uj 2 J C^ii/-^ "-"2, 



T («) T W 

x l • L 2 

ar(4 ;) 



-&4 S) 
4«) 



(5) 



c(-a;^ ) 4 /) +^/4 /) 



„(/) 



(/)„« 



) + e/z^z 



c (4 /) 4 /) 



The choice of the form of the coupling is constrained by the physical request that the solution remains in a bounded 
region of the phase space. Since 
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if the trajectory is enough far from the origin, one has that it evolves in a bounded region of the phase space. The 
parameters have the values a = 10, b = 8/3 and c = 10, the latter giving the relative time scale between the fast and 
slow dynamics. The two Rayleigh numbers are taken different, r s = 28 and rf = 45, in order to avoid sincronization 
effects. 

With the present choice, the two uncoupled systems (e s = e/ = 0) display chaotic dynamics with Lyapunov exponent 
\(f) 12.17 and AW ~ 0.905 respectively and thus a relative intrinsic time scale of order 10. 

By switching on the couplings e s and e/ we obtain a single dynamical system whose maximal Lyapunov exponent 
Amaz is close (for small couplings) to the Lyapunov exponent of the faster decoupled system (X^). We will consider 
a single realization of the couplings, with ef — 10 and e s = 10~ 2 . The global Lyapunov exponent is found to be in 
this case X max — H-5 which is indeed close to A") in the uncoupled case. With the present choice of the couplings, 
the fast dynamics is driven by means of the effective Rayleigh number r e ff = rf + efX^\t)/c and one recognize in 
the time evolution the slow- varying component of the driver (see figure [l]). 

For what concern the predictability, one expect reasonably that for small coupling e s the slow component of the 
system x s remains predictable up to its own characteristic time. On the other hand, for any coupling e^Owe obtain 
a single dynamical system in which the errors grow with the leading Lyapunov exponent X max ~ A^. The apparent 
paradox stems from saturation effects which becomes apparent as soon as one is interested in non infinitesimal errors. 

We have integrated two trajectories of (||) starting from very close initial conditions. One trajectory represents the 
"true" (reference) trajectory x and the other is the forecast (perturbed trajectory x') subjected to an initial error 
5x(0). The error is computed here by means of the Euclidean distance in the phase space 
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Figure ^reports the results for the error growth averaged over 500 experiments with 6xf(0) — 10~ 8 and Sx s (Q) = 
10 -12 . We observe that the relative magnitude of the initial errors is irrelevant for what concerns small errors because 
the error direction in the phase space will be rapidly aligned toward the most unstable direction. For small times 
(i < 2), both the errors can be considered infinitesimal and the growth rate is thus given by the global Lyapunov 
exponent X max . This is the linear regime of the error growth in which the Lyapunov exponent is the relevant parameter 
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for the predictability. For larger times, the fast component of the error, Sxf, reaches the saturation, the trajectories 
separation evolves according to the full non linear equations of motion and the growth rate for the slow component 
is strongly reduced. From figure || one observes that the slow component error Sx s is still well below the saturation 
value, and grows with a rate close to its characteristic inverse time \( S K 

We now apply the FSLE algorithm to the slow component of the the error, Sx s (figure ||). We define a series of 
m = 25 thresholds starting with <5o = 10~ 6 and ratio r = 2. The results presented (figure ||) are obtained after 
averaging over N = 500 realizations. For very small 8, the FSLE recovers the leading Lyapunov exponent X m ax, 
indicating that in small scale predictability the fast component has indeed a dominant role. As soon as the error 
grows above the coupling e s , A(<5) drops to a value close to A^ s ^ and the characteristic time of small scale dynamics is 
no more relevant. 

In figure |4| we plot the slow component predictability time (^) for a fixed initial error Sx s — 10~ 6 as a function of 
the tolerance A. We observe, as expected, an enhancement of T p as soon as one accepts a tolerance larger than the 
typical fast component fluctuation in the slow time series. Observe that the naive application of (|l]) would heavily 
underestimate the predictability time for large tolerance (dashed line). 

We now consider the second example. It is a more complex system introduced by Lorenz (Lorenz, 1996) as a toy 
model for the Atmosphere dynamics which includes explicitly both large scales (synoptic scales, slow component) 
and small scales (convective scales, fast component). The apparent paradox described above can be reformulated 
here by saying that a more refined Atmosphere model (which is able to capture the small scale dynamics) would be 
less predictable of a rougher one (which resolve only large scale motion) and thus the latter should be preferred for 
numerical weather forecasting. We will see that also in this case, the effect of the small, fast evolving, scales becomes 
irrelevant for the predictability of large scale motion if one consider large errors. 

The model introduces a set of large scale, slow evolving, variables x k and small scale, fast evolving, variables y^ k 
with k = 1, ...,K and j — 1, J. As in (Lorenz, 1996) we assume periodic boundary conditions on k (xk+u = %k> 
Uj.K+k — Uj,k) while for j we impose yj+j.fc = Vj,k+i- The equation of motion are 

^ ^ ~x k ^ 1 {x k -2-x k+ i)-x k + F -Y, J j= iVj,k 

dlk s (8) 

= -coyj+i,k {Vj+2,k - Vj-i,k) - cyj,k + x k 

in which c again represent the relative time scale between fast and slow dynamics and b is a parameter which controls 
the relative amplitude. 

Let us note that (||) has the same qualitative structure of a finite mode truncation of Navier-Stokes equation, with 
quadratic inertial terms and viscous dissipation. The coupling (with unit strength) is chosen in order to have the 
"energy" 

y k= i k=ij=i j 

conserved in the inviscid, unforced limit. The forcing term drives only the large scales and we will consider F = 10 
which is sufficient for developing chaos. 

We have performed the computation of the FSLE for system (|h with parameters as in (Lorenz, 1996): K = 36, 
J = 10, c = b = 10 implying that the typical y variable is 10 times faster and smaller than the x variable. In this case 
we choose to adopt for measuring the errors the global Euclidean norm on both the slow and fast variables (energy 
norm): this is for mimic a realistic situation in which we are not able to recognize a priori the slow component in the 
system. 

The result of the FSLE computation is displayed in figure H after averaging over N = 1000 realizations with initial 
error 5 m i„ = 10 -5 . We set m — 20 thresholds with <5o = 10 and ratio r = 2 1 / 2 . For very small errors we observe 
the saturation of A(<5) to the leading Lyapunov exponent of the system X max ~ 9.9. For errors larger than the typical 
r.m.s. value of the fast variables ({y 2 } 1 ^ 2 — 0.25) we observe a second plateau at A ~ 0.5, corresponding to the inverse 
characteristic time of large scales. We observe that the relative time scale between fast and slow motions as computed 
by the FSLE is slightly larger than the value of the parameter c. We think that this effect is due to coupling which 
here cannot be assumed small as in the previous example. 

In figure ^ we plot the predictability time (||) for fixed initial error S = 10~ 3 and different thresholds. As in the 
previous example, we observe an enhancement of the predictability time for large tolerance A with respect to the 
Lyapunov exponent estimation. For large initial errors (as it is usually the case in numerical weather forecasting) the 
predictability time is thus independent of the Lyapunov exponent. 
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IV. CONCLUSIONS 



We have shown that in systems with possess different characteristic time scales, the predictability time can be an 
independent quantity of the leading Lyapunov exponent. The latter is usually associated to the faster characteristic 
time and dominates the exponential growth of infinitesimal errors. Large errors will evolve in general with large scale 
characteristic time which thus rules large scale predictability. 

We have introduced a generalization of the Lyapunov exponent which allows to compute the average exponential 
error growth at a given error size <5. The Finite Size Lyapunov Exponent is expected to converge at the leading 
Lyapunov exponent for very small errors. For larger errors, X(S) is decreasing with 6 and thus the FSLE analysis 
predicts an enhancement of the predictability time as observed in several numerical experiments. 

We illustrate these concepts on two model examples which possess different characteristic timescales. The numerical 
computation of the FSLE confirms the predictability enhancement with respect to the Lyapunov analysis. 

Our results have a general significance which exceeds the proposed models. In particular, whenever one can identify 
in the system different features with different intrinsic time scales, one expects that slow varying quantities (i.e. 
large scale features) are predictable longer than fast evolving quantities. Moreover, our results demonstrate that 
the estimation of the predictability time for a large scale circulation model do not require to resolve the small scale 
dynamics. 
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FIG. 1. Time series of the slow variable y s (lower curve) and of the fast variable Zf (upper curve) on the attractor. 
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FIG. 2. Typical error growth for the fast component 5xf (upper curve) and for the slow component Sx s in the coupled 
Lorenz models with Sxf (0) = 10 -8 and Sx s (0) — 1CF 12 , averaged over 500 samples. In order to detect the typical behavior we 
compute the average of the logarithm. The dashed lines show the exponential growths with exponents \^ and A^ s '. 
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FIG. 3. FSLE for the two coupled Lorenz models computed from the slow variables. The parameters for the computation 
are: So = 1CF 6 , m = 25, r = 2 and iV = 500. The two horizontal lines represent the uncoupled Lyapunov exponents and 
AW. 
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FIG. 4. Predictability time for the slow component of the two coupled Lorenz models as a function of the tolerance A. The 
initial error is fixed at 8 = 10~ 6 . The dashed line represent the Lyapunov estimation T p ~ A -1 ln(A/5). 
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FIG. 5. FSLE computed for the toy Atmospheric model. The parameters for the computation are: 5o = 10 
r = 2 1/2 and N = 1000. 
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FIG. 6. Predictability time for the toy Atmospheric model as a function of the tolerance A. The initial error is 8 — 10 
The dashed line represent the Lyapunov based estimation. 
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